Chapter # 03
K Nearest Neighbor (KNN)

Introduction

Introduction (Cont’d)

What is KNN Algorithm?

How Does KNN Learn?

How Does KNN Learn? (Cont’d)

How Does KNN Learn? (Cont’d)

What Happens if the Vote is Tied?

FYI

Building KNN Algorithm

Defining the Task

Define the Learner

Train the Model

Making Predictions using our Model and Evaluating Performance of the Model

Bias-Variance Trade Off – Two Sources of Model Error

Bias-Variance Trade Off – Two Sources of Model Error (Cont’d)

Holdout Cross-validation (CV)

Holdout Cross-validation (CV) (Cont’d)

K-fold CV

K-fold CV (Cont’d)

Leave-One-Out (LOO) CV

Parameters vs Hyperparameters

Parameters vs Hyperparameters (Cont’d)

Questions or Queries

Questions

Queries